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Abstract 

In  response  to  the  requirements  of  the  Pollution  Prevention  Act  of  1990,  US  Air 
Force  Installations  worldwide  have  implemented  pollution  prevention  (PP)  programs 
designed  to  reduce  the  release  of  pollutants  to  the  environment.  Following  guidance 
produced  by  the  United  States  Environmental  Protection  Agency  (USEPA),  the  Air 
Force  uses  Opportunity  Assessments  (OAs)  to  identify  and  evaluate  waste  producing 
processes  that  could  benefit  from  a  PP  project.  The  OA  process  guidance  provides 
extensive  details  on  how  to  identify  potential  projects  and  on  how  to  economically 
evaluate  a  project  selected  for  implementation.  However,  while  it  recognizes  that  only 
a  few  of  the  identified  projects  can  be  thoroughly  evaluated,  the  guidance  provides  only 
cursory  information  about  how  to  decide  which  projects  should  be  selected  for  this 
evaluation.  This  thesis  bridges  that  gap  by  providing  a  quantitative  model  to  be  used 
for  economic  screening  of  potential  pollution  prevention  opportunities  by  USAF 
installations. 

The  model  developed  in  this  thesis  is  a  simplified  version  of  the  economic  analysis 
process  described  in  the  OA  guidance.  It  requires  a  user  to  collect  data  on  a  small 
number  of  project  costs  and  perform  a  simple  economic  computation  using  that  data. 
The  result  is  a  figure  which  estimates  the  potential  economic  beneflt  or  loss  of  a 
project.  This  figure  can  be  used  to  screen  out  projects  which  might  be  economically 
poor,  enabling  a  base  to  focus  its  money  and  efforts  on  studying  those  projects  with  the 
greatest  potential  for  economic  benefit. 
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A  QUANTITATIVE  METHOD  FOR 
SCREENING  POLLUTION  PREVENTION 
PROGRAM  OPTIONS  AT  UNITED  STATES 
AIR  FORCE  INSTALLATIONS 


L  Introduction 


Prc^lem  Description 

In  November  of  1990  the  United  States  Congress  passed  the  Pollution  Prevention 
Act.  This  law  clearly  stated  that  the  elimination  of  pollution  would  be  die  principal 
component  of  the  country's  effort  to  clean  up  its  environment.  In  response  to  the  new 
legislation,  the  US  Air  Force  (USAF)  develqied  and  initiated  a  pollution  prevention 
policy  which  was  formalized  with  Air  Force  Policy  Directive  19-4  in  1992.  This 
policy  dictated  that  all  Air  Force  installations  would  be  held  responsible  for  creating 
and  managing  their  own  pollution  prevention  (PP)  programs  (Dqit.  of  the  Air  Force, 
1992:  1). 

In  trying  to  establish  their  respective  pollution  prevention  programs,  many  Air 
Force  installations  were  faced  with  a  similar  problem  ~  how  to  implement  as  numy 
pollution  prevention  projects  as  possible  within  the  constraints  of  a  limited  budget.  The 
usual  approach  to  this  problem  has  been  to  use  the  Environmental  Protection  Agency's 
(EPA)  opportunity  assessment  (OA)  process  to  identify  and  then  implement  those 
projects  which  are  easiest  to  execute  and  have  the  greatest  economic  benefits. 

Unfortunately,  the  OA  process  can  often  be  difficult,  time-consuming,  and 
expensive.  On  top  of  that,  the  OA  process  can  waste  valuable  time,  money,  and  effort 
analyzing  projects  which  turn  out  to  be  economically  unsound.  In  the  face  of  these 
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obstacles  the  question  is,  is  there  a  way  to  identify  cost-effective  pollution  prevention 
projects  without  the  lengthy  analysis  time,  exc^sive  costs,  and  extraneous  results? 

The  answer  to  this  is  simple  -  projects  should  be  screened  before  being  subjected 
to  the  OA  process.  Screening  out  projects  which  are  not  technically  feasible,  don't 
help  attain  organizational  goals,  or  are  not  cost  effective  will  reduce  the  costs  and  time 
required  for  an  OA  and  eliminate  unnecessary  analyses.  The  EPA  recommends 
screening  as  an  integral  part  of  the  OA  process  for  these  very  reasons;  however,  the 
EPA  does  not  indicate  how  a  user  should  conduct  this  screening  process.  Thus  it  is 
clear  that  while  screening  should  be  a  part  of  any  pollution  prevention  opportunity 
assessment  process  there  are  no  guidelines  as  to  how  to  best  go  about  it. 

Unfortunately,  without  clear  guidelines,  screening  processes  can  be  overlooked, 
ignored,  or  conducted  improperly  at  many  Air  Force  Bases.  There  is  evidence  of  this 
in  opportunity  assessment  reports  from  various  Air  Force  bases,  in  which  all  potential 
projects  at  these  bases  are  fully  evaluated.  The  results  of  this  are  difficult  to  estimate, 
but  it  is  probable  that  many  bases  have  conducted  expensive  and  time-consuming 
analyses  of  numerous  projects  only  to  determine  diat  they  are  not  feasible  for 
implementation.  For  example,  in  an  OA  conducted  at  Hill  Air  Force  Base,  35  %  of  the 
109  projects  evaluated  were  found  to  be  economically  unsound  (Engineering  Science 
Inc.,  1993).  A  reliable  screening  process  would  have  identified  those  projects  as  poor 
ones  before  they  were  subjected  to  the  full  analysis,  and  thus  reduced  the  amount  of 
money  and  time  invested  in  the  OA. 

To  help  correct  this  situation,  this  research  proposes  a  method  wiiich  can  be 
effectively  used  to  screen  projects  so  as  to  minimize  the  costs  and  time  associated  with 
the  OA  process,  and  to  ensure  that  valuable  resources  are  only  expended  studying  those 
projects  which  are  most  likely  to  benefit  the  Air  Force. 
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The  purpose  of  this  study  is  to  develop  a  quantitative  technique  that  can  be  used  to 


screen  potential  pollution  prevention  projects  prior  to  selecting  them  for  a  detailed 
analysis.  The  following  research  objectives  have  been  established  to  aid  in 
accomplishing  this  purpose: 

1.  Determine  cost  categories  that  are  significant  contributors  to  the 
potential  economic  impact  of  a  PP  option  and  which  are  not. 

2.  Develop  a  simple  technique  using  those  significant  cost  categories  for 
screening  pollution  prevention  projects  prior  to  a  detailed  economic 
assessment. 

3.  Evaluate  the  technique. 

Scope  and  Limitations 

This  study  focuses  strictly  on  screening  for  cost-effectiveness.  Other  screening 
criteria,  such  as  technical  feasibility,  waste  reduction,  and  goal  attainment  are  sqjarate 
issues  which  are  not  dealt  with  in  this  thesis.  While  economic  considerations  should  be 
the  primary  criteria  used  for  selecting  pollution  prevention  projects  for  detailed  study, 
these  other  criteria  may  need  to  be  considered  at  the  discretion  of  the  decision  makers. 


II.  Background 


History 

Over  the  course  of  the  past  twenty  years,  the  United  States  Congress  has  passed 
sweeping  laws  in  an  attempt  to  control  and  clean  up  the  millions  of  tons  of  hazardous 
wastes  produced  in  the  US  each  year.  Heavy  penalties  were  imposed  on  businesses  and 
individuals,  including  government  employees,  who  were  caught  violating  those  laws. 
However,  by  1990  studies  revealed  that  the  problem  had  not  diminished  significantly. 
Technologies  for  treating  and  disposing  of  hazardous  wastes  were  simply  not  adequate 
for  dealing  with  the  quantity  of  wastes  produced  in  the  US.  For  example,  although 
landfills  have  been  a  generally  accepted  method  for  disposing  of  hazardous  wastes,  a 
1990  study  by  the  US  Environmental  Protection  Agency  (EPA)  showed  that  a  majority 
of  US  landfills  were  no  longer  effectively  containing  the  wastes  they  were  built  to  hold 
(Hazardous  Waste  News,  1990).  This  led  to  the  conclusion  that  the  so-called  'end-of- 
pipe'  controls  advocated  since  the  1970's  were  not  effective,  and  a  different  method  of 
hazardous  waste  control  was  needed.  The  obvious  choice  was  pollution  prevention. 

Once  the  need  for  a  change  was  realized.  Congress  passed  the  Pollution  Prevention 
Act  of  1990.  This  law  contained  a  number  of  provisions,  but  the  most  important  of 
them  spelled  out  in  no  uncertain  terms  the  new  philosophy  for  waste  control: 

The  Congress  hereby  declares  it  to  be  the  national  policy  of  the  United 
States  that  pollution  should  be  prevented  or  reduced  at  the  source 
whenever  feasible;  pollution  that  cannot  be  prevented  should  be  recycled 
in  an  environmentally  safe  manner,  whenever  feasible;  pollution  that 
cannot  be  prevented  or  recycled  should  be  treated  in  an  environmentally 
safe  manner,  whenever  feasible;  and  disposal  or  other  release  into  the 
environment  should  be  employed  only  a  last  resort  and  should  be 
conducted  in  an  environmentally  safe  manner.  (United  States  Congress, 

1990:  1) 
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Clearly,  the  goal  of  Congress  was  to  get  the  nation  to  think  of  preventing  pollution 
first,  and  only  after  exhausting  all  pollution  prevention  possibilities  could  the  accq>ted 
methods  of  treatment  and  disposal  be  used. 

As  part  of  the  Pollution  Prevention  Act,  Congress  tasked  the  EPA  with  developing 
guidelines  to  help  the  nation's  businesses  and  government  facilities  implement  PP 
programs.  To  this  end,  the  EPA  established  an  information  clearinghouse  to  collect 
and  disseminate  information  on  PP  issues,  initiated  research  projects  to  explore  PP 
technologies,  and  distributed  new  guidelines  for  hazardous  waste  control  emphasizing 
pollution  prevention  (EPA,  1992).  One  result  of  their  efforts  was  a  renewed  emphasis 
on  a  process  called  opportunity  assessment  (OA). 

The  Opportunity  Assessment  Process 

First  developed  in  1988  as  part  of  the  Manual  for  Waste  Mirumization  Opportunity 
Assessments,  the  EPA's  q)portunity  assessment  process  is  a  method  for  identifying  and 
analyzing  potential  waste  minimization  options  at  a  business  or  similar  ^ility  (EPA, 
1988).  It  was  initially  intended  to  help  companies  improve  their  compliance  with  the 
1984  Resource  Conservation  and  Recovery  Act,  and  so  it  focused  primarily  on  land- 
based  hazardous  waste  issues.  After  the  Pollution  Prevention  Act  was  passed  the  EPA 
reworked  the  OA  process  to  incorporate  air  and  water  based  issues  as  well,  and 
redistributed  the  guidance  in  the  1992  Facility  Pollution  Prevention  Guide. 

The  EPA  guidance  on  the  OA  process  is  extensive,  but  it  can  be  summarized  by 
the  four-step  process  shown  in  Table  1  below  (EPA,  1988:  4;  EPA,  1992:  12  -  16). 

The  first  step,  PRELIMINARY  ASSESSMENT,  involves  the  selection  of  experts 
to  form  an  assessment  team,  which  then  surveys  installation  activities  and  constructs  a 
list  of  potential  pollution  prevention  projects  which  could  reduce  or  eliminate  some 
wastes.  In  the  next  step,  SCREENING,  imtallation  officials  use  subjective  criteria  to 
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Table  1  -  The  EPA's  Opportunity  Assessment  Process 


STEP  1 

STEP  2 

STEP  3 

STEP  4 

PRELIMINARY 

ASSESSMENT 

SCREENING 

ANALYSIS 

IMPLEMENTATION 

Fonn  assessment 
team.  Survey 
installation  activities. 
List  possible  PP 
projects. 

Screen  list.  Select 
some  projects  for 
further  study. 

Perform  in-depth 
analysis  on  projects 
selected  in  Step  2. 
Select  projects  for 
stq>  4. 

Implement  pollution 
prevention  projects  on 
waste  streams  selected  in 
Step  3. 

review  the  list  from  Step  1 ,  and  then  they  select  some  of  the  projects  for  further  study. 
The  third  step,  ANALYSIS,  includes  an  in-depth  economic  study  of  each  project 
selected  in  the  screening  step.  Those  with  the  greatest  potential  economic  benefits  are 
then  recommended  for  the  final  step,  IMPLEMENTATION. 

Screening 

In  the  Facility  Pollution  Prevention  Guide,  the  EPA  provides  little  direction  as  to 
how  to  screen  pollution  prevention  projects.  It  offers  a  list  of  questions  which  should 
be  considered  and  states  that  "screening  procedures  can  range  from  an  informal  review 
with  a  decision  made  by  either  the  program  manager  or  a  vote  of  the  team  members,  to 
the  use  of  quantitative  decision-making  tools"  (EPA,  1992),  which  doesn't  tell  the  user 
very  much  about  how  to  screen  projects.  However,  this  statement  does  seem  to  imply 
that  the  use  of  "quantitative  decision-making  tools"  is  the  most  preferable  screening 
option,  and  thus  their  use  should  provide  a  better  screening  process.  Thus  it  is 
reasonable  to  assume  that  if  an  installation  had  such  a  quantitative  tool  then  it  would  be 
able  to  conduct  an  effective  screening  process. 

Air  Force  Guidance 

In  response  to  the  1990  Pollution  Prevention  Act,  the  Air  Force  developed  and 
initiated  a  comprehensive  pollution  prevention  policy  which  was  formalized  with  Air 
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Force  Policy  Directive  19-4  in  1992.  This  policy  clearly  stated  that  all  Air  Force 
installations  would  be  held  responsible  for  creating  and  managing  their  own  PP 
programs  (E>ept.  of  the  Air  Force,  1992:  1).  Guidance  on  how  this  was  to  be  done  was 
provided  in  the  US  Air  Force  Installation  Pollution  Prevention  Program  Manual  (EA 
Engineering,  Science,  and  Technology,  Inc.,  1992).  This  manual,  which  is  still  the 
primary  resource  for  Air  Force  PP  programs,  is  based  largely  on  the  previously 
mentioned  EPA  documents,  the  Manual  For  Waste  Minimization  Opportunity 
Assessments  and  the  Facility  Pollution  Prevention  Guide.  However,  while  it  does 
specifically  address  the  Air  Force  perspective  on  pollution  prevention,  it  does  not  offer 
any  significant  deviations  from  the  EPA's  guidance  on  OAs.  Hence  the  problem  of 
insufficient  guidance  for  the  opportunity  assessment  process,  particularly  that  dealing 
with  the  screening  phase,  was  not  addressed  or  corrected  by  published  Air  Force 
procedures.  The  presence  of  this  problem  gives  rise  to  an  increased  potential  for  the 
unnecessary  waste  of  resources.  In  these  days  of  continually  shrinking  budgets,  those 
resources  are  more  valuable  than  ever,  and  the  Air  Force  simply  cannot  afford  to 
tolerate  such  practices  any  longer. 

The  Air  Force  Materiel  Command  Perspective 

The  Air  Force  Materiel  Command  (AFMC)  is  the  USAF  major  command 
responsible  for  depot-level  maintenance  and  repair  of  all  Air  Force  aircraft  and  for 
other  support  functions  such  as  vehicle  maintenance  and  battery  sh(^  operations.  In 
performing  its  mission,  AFMC  generates  over  80  percent  of  the  Air  Force's  hazardous 
wastes,  and  as  such  the  command  is  very  interested  in  employing  pollution  prevention 
strategies  to  reduce  those  wastes.  To  facilitate  this,  AFMC  initiated  opportunity 
assessments  at  all  of  its  bases,  starting  in  1992.  In  this  respect,  AFMC  has 
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demonstrated  that  it  is  determined  to  be  the  Air  Force  leader  in  pollution  prevention, 
despite  limited  funding. 

However,  in  December  1993  AFMC  published  a  review  of  the  completed  OAs 
which  revealed  that  there  were  some  problems  with  the  OAs  which  necessitated  further 
work.  The  review,  done  by  AFMC's  environmental  directorate,  stated  in  one  of  its 
findings  that  AFMC  needed  to  "develop  a  Command-wide  standardized  method  for 
completing  opportunity  assessments"  (Air  Fore?  Materiel  Command,  1993:  34),  and 
that  as  part  of  that  method,  "a  Total  Life  Cycle  Cost  Analysis  should  be  performed  for 
proposed  pollution  prevention  options  which  involve  significant  commitments  of  Air 
Force  dollars"  (Air  Force  Materiel  Commai^,  1993:  34).  These  deficiencies  clearly 
are  not  unique  to  AFMC,  but  they  are  both  problems  inherent  to  the  opportunity 
assessment  process.  AFMC's  need  to  deal  with  these  problems  lends  further  support  to 
the  need  for  this  research. 

One  of  the  OAs,  performed  at  Hill  AFB,  Utah,  was  singled  out  by  the  study 
because  it  contained  a  detailed  economic  analysis  while  the  remaining  OAs  contained 
only  limited  cost  data.  The  Hill  AFB  OA  provided  base  leaders  with  not  only  valuable 
technical  information,  but  critical  economic  data  that  provided  a  sound  basis  for  their 
project  implementation  decisions.  The  fact  that  only  one  of  AFMC’s  sixteen 
installations  spent  the  money  for  a  detailed  economic  assessment  leads  one  to  suspect 
that  in  trying  to  save  dollars  many  bases  chost  not  to  include  economic  evaluations  in 
the  OAs  they  conducted.  This  is  potentially  dangerous,  because  without  complete 
information  projects  that  could  cost  the  Air  Force  money  in  the  long  run  might  be 
selected  for  implementation. 
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Building  the  Screening  Model 


Having  established  that  the  Air  Force  is  in  need  of  a  screening  tool  for  its  OA 
processes,  it  is  now  necessary  to  explore  how  that  tool  should  be  constructed. 

As  mentioned  previously,  one  purpose  of  screening  pollution  prevention  projects  is 
to  identify  those  which  are  economically  sound  and  those  which  arc  not.  This  purpose 
is  essentially  the  same  as  that  of  a  detailed  economic  assessment  performed  in  Stq>  3  of 
an  OA,  except  that  an  economic  analysis  is  complex  with  many  inputs,  while  a 
screening  process  should  be  simple  and  require  only  a  few  inputs.  It  is  reasonable  to 
assume  then  that  a  screening  process  and  an  economic  analysis  process  might  both 
employ  similar  methods  to  accomplish  their  similar  purposes,  differing  only  in 
complexity  and  level  of  effort.  With  that  in  mind,  this  research  approaches  the 
construction  of  a  screening  process  by  starting  with  the  economic  analysis  process  and 
working  to  remove  complexity  and  effort  while  retaining  the  result.  Having  said  that, 
it  then  becomes  necessary  to  describe  the  economic  analysis  process. 

Economic  Analysis 

The  EPA  currently  recommends  use  of  a  technique  called  Total  Cost  Assessment 
(TCA),  also  known  as  Life  Cycle  Costing,  for  conducting  the  detailed  economic 
analysis  phase  of  the  opportunity  assessment  (EPA,  1992:  59).  TCA  considers  all 
possible  costs  of  a  project  throughout  the  entire  economic  'life'  of  that  project.  It 
recognizes  the  fact  that  the  up-front  purchase  price  of  a  project  is  not  always 
representative  of  the  total  cost  of  that  project,  and  so  other  costs,  such  as  those  related 
to  (^rations  and  maintenance,  labor,  training,  and  disposal,  are  considered  in  TCA. 

The  first  and  most  important  step  of  TCA  is  the  selection  of  the  cost  categories  to 
be  considered  in  the  analysis.  For  pollution  prevention  projects,  R.T.  McHugh  has 


9 


identified  four  tiers  of  potential  costs  which  should  be  considered  in  any  TCA  analysis 
of  a  PP  project  (EPA,  1993:  5-6): 

Tier  0:  Direct  costs,  such  as  capital  c(»ts,  procurement  costs,  labor  costs,  and 
waste  disposal  costs. 

Tier  1:  Indirect  costs,  such  as  administrative  costs,  insurance  costs,  analytical 
costs,  and  training  costs. 

Tier  2:  Liability  costs,  such  as  penalties  for  non-compliance,  fines,  and  potential 
cleanup  costs. 

Tier  3:  Intangible  costs,  such  as  employee  relations,  changes  in  public  image, 
and  corporate  relationships. 

Once  the  costs  categories  are  identified  and  the  actual  costs  are  determined,  TCA 
employs  economic  tools  to  evaluate  those  costs  over  a  long  period  of  time.  Air  Force 
Pamphlet  178-8,  "Economic  Analysis  Procedures  Handbook",  recommends  use  of 
present  value/net  present  value  procedures  for  performing  this  evaluation. 

Present  Value/Net  Present  Value.  Present  Value  is  an  economic  tool  that  takes  into 
account  the  fact  that  money  in  hand  now  is  worth  more  than  money  received  in  the 
future,  due  to  the  power  of  money  to  earn  interest  over  time.  Mathematically  it  can  be 
calculated  using  the  following  equation: 


PV  = 


F 

(l+r)“ 


(1) 


where  PV  is  the  present  value,  F  is  the  future  value,  r  is  the  interest  rate,  and  n  is  the 
number  of  periods.  The  Net  Present  Value  (NPV)  is  simply  the  sum  of  the  present 
values  of  each  of  the  payments.  The  following  example  shows  how  this  is  computed. 

Consider  a  process  which  currently  costs  a  base  $20,000  per  year  to  operate. 
Assume  that  this  process  will  only  be  necessary  for  the  next  three  years.  This  produces 
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the  payment  stream  shown  in  Figure  1  below.  (Down  arrows  represent  costs;  up 
arrows  would  indicate  benefits.) 


Figure  1.  Example  Payment  Stream 


Assume  that  the  applicable  interest  rate  is  10%  -  this  is  the  standard  figure 
recommended  in  government  cost  estimating  guidance  (Dept,  of  the  Air  Force,  1988), 
and  assume  that  the  interest  is  only  compounded  once  per  year.  Using  this  information 
and  equation  3.1,  present  values  can  be  calculated  for  each  of  the  payments  as  follows: 


PV 


_ _ $0 


yearO 


(I+.IO)' 


0 


:$0 


(2) 


(l+.lO)^ 


(3) 


PV 


_  -$20,000 


(1+.10)2 


-$16528.92 


(4) 


PV  3  =  -^^^>^  =  -$15026.29  (5) 

yearj  iq)^ 


Simply  summing  the  four  present  values  yields  the  net  present  value,  -$49,737.02. 
This  figure  rqiresents  the  amount  which,  if  placed  in  a  bank  in  year  0  at  10%  interest, 
would  cover  all  costs  of  the  current  process  over  its  three  year  life. 


11 


Measuring  Economic  Soundness 

The  purpose  of  any  economic  analysis  is  to  indicate  the  economic  soundness  of  the 
project  or  projects  being  studied.  Economic  soundness  is  a  measure  of  how  good  or 
bad  a  project  is  when  compared  economically  with  the  current  mode  of  (^ration.  If 
the  project  is  expected  to  cost  less  or  earn  more  money  than  the  current  process,  then  it 
is  considered  economically  sound.  If  the  project  is  expected  to  cost  more  or  earn  less 
money  than  the  current  process,  than  it  is  considered  economically  unsound.  The  basic 
indicator  of  economic  soundness  is  the  Net  Present  Value  (NPV).  Typically,  any 
project  with  an  NPV  greater  than  zero  is  considered  economically  sound,  and  any 
project  with  an  NPV  less  than  zero  is  considered  economically  unsound.  However,  in 
practice,  there  will  most  likely  be  a  range  around  zero  (i.e.  0  ±  $10,000)  in  which  a 
user  may  consider  other  factors  such  as  available  funds  and  quality  of  cost  data  to  make 
a  subjective  judgment  of  economic  soundness.  While  this  range  is  subjeaive,  one 
feasible  way  of  specifying  it  is  to  relate  it  to  the  project  investment  cost.  For  example, 
a  base  may  decide  that  a  project  is  acceptable  if  its  NPV  indicates  a  return  of  at  least 
10%  of  its  investment  cost  over  its  life,  it  will  be  unacceptable  if  its  NPV  indicates  a 
loss  of  more  than  10%  of  its  investment  cost  over  its  life,  and  if  its  NPV  falls  between 
those  two  values  then  the  project  may  warrant  further  study. 

The  Screening  Model  Defined 

In  order  for  the  proposed  screening  model  to  be  useful,  it  must  meet  two  criteria. 
First,  it  must  effectively  indicate  economic  soundness.  Since  the  model  will  be  derived 
from  the  Total  Cost  Assessment  process,  this  requirement  will  undoubtedly  be  met. 

It's  effectiveness  can  be  measured  by  applying  the  model  to  projects  which  have 
already  been  economically  analyzed,  and  calculating  the  number  of  times  the  model 
correctly  indicates  the  economic  soundness.  The  model  does  not  need  to  be  100% 
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effective.  It  should,  however,  be  effective  enough  that  it  correctly  indicates  economic 
soundness  a  majority  of  the  time. 

The  second  criteria  is  that  the  model  must  require  a  minimum  of  effort  to  use. 

This  implies  that  the  model  must  use  as  little  data  as  possible,  therefore  the  number  of 
cost  categories  providing  input  to  the  model  must  be  minimized.  In  order  to  maintain  a 
high  degree  of  effectiveness,  the  cost  categories  which  are  used  in  the  screening  model 
must  be  those  which  have  the  greatest  impact  on  economic  soundness.  These  cost 
categories  are  hereafter  called  the  most  sign^cant  categories,  and  the  next  chapter  will 
describe  the  process  by  which  they  are  identified. 

Data  Collection 

In  order  to  properly  develop  a  screening  tool  from  the  economic  analysis  process, 
it  is  necessary  to  have  some  data.  With  the  aid  of  personnel  at  ProAct,  an  Air  Force 
environmental  research  office  located  at  the  Air  Force  Center  for  Environmental 
Excellence,  Brooks  AFB,  Texas,  a  search  was  conducted  for  reports  from  completed 
opportunity  assessments  at  US  Air  Force  bases.  While  the  search  turned  up  a  number 
of  reports,  only  one  contained  any  usable  economic  data.  This  report,  from  Hill  AFB, 
was  obtained  and  used  as  the  database  for  this  research. 

Hill  Air  Force  Base 

Hill  Air  Force  Base,  Utah,  is  home  to  the  Ogden  Air  Lx>gistics  Center,  a  dqiot- 
level  maintenance  facility  designed  to  conduct  complete  refurbishing  of  F-16,  F-4,  and 
C-130  aircraft.  Peacekeeper  and  Minuteman  missile  systems,  and  landing  gear  for  all 
Air  Force  weapons  systems.  In  addition  to  this.  Hill  AFB  performs  its  regular  Air 
Force  base  operations  and  maintenance  missions,  including  vehicle  operations,  civil 
engineering,  and  support  of  active  duty  F-16  aircraft.  Overall,  these  activities  generate 
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more  than  250  different  hazardous  waste  streams,  producing  approximately  100 
different  types  of  waste.  This  diversity  of  missions  makes  Hill  AFB  representative  of 
AFMC  bases,  and  the  types  of  projects  studied  at  Hill  AFB  are  representative  of  those 
likely  to  be  found  at  other  A.FMC  bases. 

The  Hill  AFB  Opportunity  Assessment 

The  Hill  AFB  opportunity  assessment  was  performed  by  Engineering  Science  Inc. 
(ESI),  an  independent  engineering  consulting  company  working  on  a  government 
contract.  The  OA  was  initiated  in  March  1992,  and  was  completed  in  May  1993. 

ESI's  first  step  was  to  collect  and  organize  data  on  over  250  waste-producing  processes 
at  Hill  AFB.  Projects  were  then  screened  for  technical  feasibility,  and  similar  projects 
at  different  locations  were  lumped  together.  This  reduced  the  number  of  projects 
considered  to  125.  ESI  then  undertook  a  comprehensive  economic  analysis  of  those 
125  projects.  As  additional  data  was  collected  during  this  phase  some  projects  were 
combined  or  eliminated  from  consideration,  and  in  the  end  complete  economic  analyses 
were  produced  on  109  PP  projects.  These  economic  analyses  each  considered  15 
different  cost  categories  which  could  impact  a  pollution  prevention  project.  The 
following  sections  briefly  describe  these  cost  categories. 

Process  Equipment  Costs.  The  cost  of  any  new  equipment  required  to  implement 
the  pollution  prevention  project. 

Construction  Materials  Costs.  The  costs  of  any  necessary  materials  required  to 
facilitate  installation  of  new  equipment  or  facilities  associated  with  the  PP  project. 

This  category  was  broken  down  into  four  sub-categories:  Piping  costs.  Electrical 
Materials  costs.  Instrument  costs,  and  Structural  Materials  costs. 

Utility  Connections/Systems  Costs.  The  costs  of  any  necessary  increases  in  usage 
of  utility  connections  or  systems  as  part  of  the  PP  project.  This  category  was  broken 
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down  into  eight  sub-categories:  Electrical,  Steam,  Cooling  Water,  Process  Water, 
Refrigeration,  Fuel  (Gas  or  Oil),  Plant  Air,  and  Inert  Gas. 

Site  Preparation  Costs.  The  costs  associated  with  any  necessary  preparations  or 
improvements  made  to  the  site  of  the  PP  project. 

InstiUlation  Costs.  The  costs  associated  with  the  installation  of  any  equipment 
required  by  the  PP  project.  This  category  was  broken  down  into  three  sub-categories: 
Vendor  costs.  Contractor  costs,  and  In-House  Staff  costs. 

Training  Costs.  The  costs  incurred  as  a  result  of  increases  in  worker  training 
necessitated  under  the  PP  project. 

Engineering  Costs.  The  costs  of  designing  new  facilities  or  systems  required  to 
support  the  PP  project. 

Start-Up  Costs.  The  costs  associated  with  initial  startup  of  new  systems  required 
by  the  PP  project.  This  category  was  broken  down  into  three  subcategories:  Vendor 
costs.  Contractor  costs,  and  In-House  Staff  costs. 

Permitting  Costs.  The  cost  of  obtaining  new  permits  necessitated  by  the  PP 
project.  This  category  was  broken  down  into  two  sub-categories:  Fees  and  In-House 
Staff  Costs. 

Input  Material  Costs.  The  costs  of  material  inputs  to  the  process  being  changed 
under  the  PP  project. 

Salvage  Value.  Actually  a  financial  gain,  this  category  is  tracked  as  a  negative 
cost.  It  contains  benefits  realized  from  the  sale  of  materials  and  equipment  made 
available  under  the  PP  project.  This  category  was  broken  down  into  two  sub¬ 
categories:  Equipment  benefits  and  Materials  benefits. 

Disposal  Costs.  The  costs  associated  with  the  handling,  transportation,  treatment, 
and  disposal  of  wastes  generated  by  the  process  being  considered  under  the  PP  project. 
This  category  was  broken  down  into  four  sub-categories:  TSDF  Fees,  On-Site 
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Treatment  Costs,  On-Site  Storage  and  Handling  Costs,  and  Permitting  and  Rqwrting 
Costs. 

Research  and  Development  Costs.  The  costs  associated  with  the  development  of 
new  technologies  to  be  used  as  part  of  the  PP  project. 

Other  Operations  and  Maintenance  Costs.  The  costs  associated  with  the  day-to- 
day  operation  and  maintenance  of  the  equipment  and  systems  which  are  part  of  the 
process  being  considered  under  the  PP  project.  This  category  was  broken  down  into 
four  sub-categories;  Labor  costs.  Supplies  costs.  Analytical  costs,  and  Miscellaneous 
O&M  Costs. 

By-Product  Recovery  Value.  Actually  a  financial  gain,  this  category  is  tracked  as  a 
negative  cost.  It  contains  benefits  realized  from  the  sale  or  reuse  of  by-products 
recovered  as  part  of  the  process  being  considered  under  the  PP  project. 

A  sample  computation  sheet  from  the  full  economic  analysis  performed  by 
Engineering  Science  Corp.  is  attached  at  Appendix  A. 

There  are  other  categories  which,  according  to  McHugh,  should  have  been 
included  in  the  analysis.  Among  them  are  liability  costs,  medical  costs,  emergency 
response  costs,  and  others.  Unfortunately,  since  these  were  not  included  in  the  Hill 
AFB  OA,  no  data  for  these  cost  categories  is  available.  It  is  possible  that  data  for  these 
categories  would  impact  the  results  of  this  study,  but  without  data  it  is  impossible  to 
draw  any  conclusions  in  that  respect.  If  additional  data  does  become  available,  this 
may  warrant  further  study. 
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III.  Methodology 

Introduction 

This  thesis  uses  a  straightforward  process  to  develop  the  screening  model, 
summarized  with  the  flowchart  in  Figure  2  below.  In  Step  1,  some  basic  data  analysis 
tools  are  employed  to  determine  which  of  the  cost  categories  are  most  significant. 

Then,  in  Step  2,  a  Net  Present  Value  is  calculated  for  each  of  the  109  projects  in  the 
dataset  using  only  the  most  significant  cost  category.  In  Step  3  these  new  NPVs  are 
then  compared  with  the  actual  project  NPVs,  and  a  determination  is  made  as  to  whether 
the  new  NPVs  accurately  indicate  the  economic  soundness  of  the  projects  or  not.  If 
not,  then  in  Step  4  another  significant  cost  category  is  added,  and  Stq>s  2,  3,  and  4  are 
repeated  until  enough  cost  categories  are  included  in  the  model  to  accurately  indicate 
economic  soundness.  The  remainder  of  this  chapter  contains  more  detailed  discussions 
on  each  of  Jiese  steps. 
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Exploratory  Data  Analysis 

The  initial  intent  of  this  thesis  was  to  use  linear  regression  techniques  to  determine 
the  "best”  economic  analysis  model  which  could  be  used  to  indicate  the  economic 
soundness  of  a  pollution  preyention  project.  Howeyer,  after  brief  inspection  it  was 
eyident  that  regression  methods  were  not  appropriate  because  the  "best"  model  was 
already  known;  it  is  simply  the  Total  Cost  Assessment  model  which  the  EPA  already 
recommends  for  this  purpose.  Thus  the  need  arose  for  an  alternatiye  approach  to  the 
problem.  The  method  chosen  was  exploratory  data  analysis. 

The  Encyclopedia  of  Statistical  Sciences  describes  exploratory  data  analysis  (EDA) 
as  "the  attitude,  approach,  and  techniques  ...  for  flexible  probing  of  data  before  any 
probabilistic  model  is  ayailable.”  (Kotz,  et  al.,  1982)  As  such,  it  is  generally  the  first 
contact  with  a  dataset  during  an  analysis.  Its  purpose  is  to  employ  any  of  a  number  of 
techniques  to  identify  patterns,  distributions,  relationships,  and  abnormalities  in  the 
data,  and  reyeal  them  in  a  way  which  is  readily  £q)parent  to  the  analyst  and  other 
obseryers.  The  focus  of  an  EDA  is  on  finding  eyidence  of  the  existence  of  a 
probabilistic  model.  One  of  the  key  aspects  of  exploratory  data  analysis  is  that  it  is 
yery  flexible.  An  analyst  can  choose  to  employ  only  those  techniques  which  are  most 
iq)propriate  for  the  data,  and  as  patterns  are  reyealed  within  the  data  tiie  choice  of 
techniques  may  be  altered  to  fit  the  changing  situation. 

There  are  four  general  themes  in  exploratory  data  analysis:  resistance,  residuals, 
re-expression,  and  display.  (Kotz,  et.al.,  1982)  The  first  two  are  not  used  in  this 
thesis  and  thus  are  not  explained  here.  The  third  theme,  re-expression,  inyolyes  the 
mathematical  transformation  of  the  raw  data  to  a  scale  which  facilitates  the  analysis. 
The  most  common  form  of  re-expression  is  the  logarithmic  transformation,  (Kotz,  et 
al),  but  in  this  thesis  a  linear  transformation  will  be  used.  The  fourth  theme  of  EDA, 
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display,  is  concerned  with  the  use  of  graphical  techniques  to  visually  reveal  the  features 
of  the  data. 

EDA  techniques  will  be  used  in  this  thesis  to  examine,  transform,  and  visually 
assess  the  data  collected  by  Hill  Air  Force  Base.  The  goal  of  the  EDA  is  to  identify 
any  cost  categories  which  are  more  significant  than  others,  build  them  into  a  potential 
screening  model,  and  evaluate  that  model's  effectiveness  at  indicating  economic 
soundness. 

Determining  Relative  Significance  of  the  Cost  Categories 

Significant  cost  categories  are  those  which  make  the  greatest  contributions  to  the 
economic  soundness  of  a  project.  The  significance  of  a  cost  category  is  best  measured 
by  figuring  what  portion  of  the  total  cost  is  contributed  by  each  category.  For 
example,  consider  Project  A,  which  is  being  evaluated  using  three  cost  categories: 
Equipment,  which  is  a  $15,000  investment  (up-front)  cost.  Materials,  which  is  a 
$10,000  annual  cost,  and  Labor,  which  is  a  $25,000  annual  cost.  Assuming  a  3-year 
economic  life  for  this  project,  the  present  values  of  these  cost  categories  are  calculated 
to  be  -$15,000  for  Equipment,  -$24,868.52  for  Materials,  and  -$62,171.30  for  Labor. 
The  total  cost  is  the  sum  of  these  present  values,  or  -$102,039.82.  The  portion  of  the 
total  cost  contributed  by  Equipment  is  -$15,000/-$102,039.82,  or  .147.  Similarly,  the 
portion  contributed  by  Materials  is  .244,  and  the  portion  contributed  by  Labor  is  .609. 
Of  these  three  categories.  Labor  is  the  most  significant,  due  to  its  greater  contribution 
to  the  total  cost,  and  conversely.  Equipment  is  the  least  significant  category. 

In  this  thesis,  these  proportional  contributions  will  be  multiplied  by  100  to  convert 
them  to  percentages,  and  these  new  figures  will  be  referred  to  as  percentage 
contributions.  Percentage  contributions  are  useful  because  they  can  be  easily  be 
compared  from  one  project  to  another.  For  example,  consider  Project  B,  which  is 
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evaluated  using  the  same  three  cost  categories  as  Project  A  above.  In  this  case. 
Equipment  costs  are  $50  up  front,  Materials  costs  are  $40  per  year,  and  Labor  costs  are 
$10  per  year.  Present  values  for  these  costs  are  -$50  for  Equipment,  -$99.47  for 
Materials,  and  -$24.86  for  Labor,  yielding  a  total  project  cost  of  -$174.33.  Thus  the 
percentage  contribution  of  Equipment  is  28.68%,  Materials  is  57.06%,  and  Labor  is 
14.26% .  Comparing  project  A  to  project  B  on  the  basis  of  dollars  alone  does  not 
reveal  much  (i.e.  Equipment  is  -$15,000  in  Project  A  and  -$50  in  Project  B.  In  which 
project  is  it  more  significant?).  Using  percentage  contribution  figures  for  comparison 
clearly  indicates  which  cost  categories  are  more  significant  within  each  project  (Labor 
in  Project  A,  Materials  in  Project  B),  and  which  project  a  category  is  more  significant 
in  (Materials  is  more  significant  in  Project  B  than  in  Project  A). 

Percentage  contributions  have  been  calculated  for  each  of  the  fifteen  cost  categories 
in  each  of  the  109  projects  of  the  Hill  AFB  dataset.  These  percentage  contributions 
were  averaged  for  each  cost  category  across  all  109  projects,  resulting  in  a  set  of  values 
representing  the  percentage  contributions  of  each  cost  category  for  an  "average" 
project.  The  cost  category  with  the  greatest  average  percentage  contribution  is 
considered  the  most  significant  category.  The  one  with  the  second  greatest  average 
percentage  contribution  is  the  next  most  significant,  and  so  on  through  all  fifteen 
categories.  The  result  of  this  is  a  listing  of  all  cost  categories  in  order  fi-om  greatest  to 
least  significance,  which  is  presented  in  the  next  chapter.  This  thesis  presumes  that 
upon  inspection  some  cost  categories  will  clearly  be  much  more  significant  than  others, 
and  only  these  "most  significant"  cost  categories  will  be  used  in  developing  a  screening 
model. 
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Calculation  and  Comparison  of  NPVs 


Once  the  relative  significance  of  the  cost  categories  has  been  determined,  the 
model  development  continues  by  selecting  the  most  significant  cost  category  and 
calculating  a  new  NPV  for  each  project  using  only  the  data  from  that  cost  category. 
For  example,  using  the  figures  for  project  A  above.  Labor  is  seen  to  be  the  most 
significant  cost  category.  Using  just  the  Labor  costs,  and  assuming  the  same  3-year 
economic  life  for  the  project,  a  payment  stream  is  developed  consisting  of  $0  in  year  0 
and  costs  of  $25,000  in  each  of  years  1,  2,  and  3.  The  NPV  of  this  payment  stream  is 
-$62,171.30. 

Once  calculated,  each  new  NPV  is  then  compared  with  the  actual  NPV  of  its 
respective  project,  which  was  calculated  using  all  of  the  available  cost  categories. 
Recall  from  Chapter  II  that  when  measuring  economic  soundness,  a  project's  NPV  can 
fall  into  one  of  three  regions  of  economic  soundness  --  economically  sound,  unsound, 
or  questionable  (See  Figure  3  below).  For  purposes  of  this  research,  the  questionable 
region  is  defined  as  0  ±  20%  of  the  project  investment  cost.  For  example,  if  the 
project  being  screened  requires  a  $1000  investment  up  front,  then  the  questionable 
range  of  economic  soundness  is  between  $2(X)  and  -$200,  and  thus  projects  with  NPVs 
greater  than  $200  are  economically  sound  and  projects  with  NPVs  less  than  -$2(X)  are 
economically  unsound.  If  the  new  NPV  and  actual  NPV  both  hill  into  the  same  region 
of  economic  soundness,  then  the  new  NPV  correctly  indicates  the  economic  soundness 
of  the  project  and  is  declared  a  match.  If  the  new  NPV  hills  into  a  different  region  of 
economic  soundness  than  the  actual  NPV,  then  the  new  NPV  does  not  indicate  the 
economic  soundness  of  the  project  and  a  mismatch  results. 
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In  order  to  prc^rly  assess  the  effectiveness  of  the  model,  this  conq)arison  must  be 
rq)eated  for  a  number  of  projects,  and  the  total  number  of  matches  determined.  The 
model's  effectiveness  is  then  calculated  by  divkiing  the  number  of  matches  by  the  total 
number  of  projects.  For  example,  if  100  projects  were  being  evaluated  using  a 
particular  model,  and  after  com[mring  NPVs  computed  using  die  model  with  the  actual 
project  NPVs  a  total  of  8S  matches  were  found,  the  model's  effectiveness  would  be 
calculated  as  85/100  or  85%.  If  the  effectiveness  is  not  judged  to  be  high  enou^,  then 
further  significant  cost  categories  may  be  added  to  the  model  until  the  desired 
effectiveness  is  achieved.  When  adding  further  cost  categcxies  to  the  model  does  not 
improve  effectiveness  enough  to  justify  the  increase  in  data  collection  workload 
associated  with  those  additional  cost  categories,  then  no  further  cost  categories  need  be 
included  and  the  model  is  complete. 
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The  data  from  the  Hill  AFB  study  contains  cost  infmnation  for  IS  cost  categories 
in  each  of  109  potential  pollution  prevention  projects.  This  information  is  summarized 
in  the  listing  aOached  at  A{^ndix  B.  Using  the  procedures  outlined  in  the  previous 
chapter,  this  cost  data  was  easily  converted  to  percentage  contributions  by  dividing  the 
value  of  each  of  the  cost  categ(X‘ies  by  the  total  cost  for  each  project.  The  resulting 
dataset  is  also  included  in  Appendix  B. 

From  the  percentage  contribution  dataset,  a  simple  arithmetic  average  was 
calculated  for  each  of  the  IS  cost  categories  ^ross  all  109  projects,  and  the  resulting 
list  is  then  ordered  from  largest  to  smallest  average  percentage  contribution.  Shown 
graphically,  this  list  appears  as  shown  in  Figure  4  below. 


Figure  4.  Ordered  Display  of  the  Average  Percentage  Contribution  of  Each  Cost 

Category  to  Total  Project  Cost 
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As  described  in  the  previous  chapter,  the  cost  category  with  the  largest  average 
percentage  contribution  is  considered  the  most  significant  cost  category.  Similarly,  the 
category  with  the  next  greatest  percentage  contribution  is  the  second  most  significant 
cost  category,  and  so  on  down  to  the  category  with  the  smallest  percentage  contribution 
which  is  considered  least  significant.  Figure  3  clearly  shows  that  Ii^ut  Materials  is  the 
most  significant  cost  category.  The  graph  also  shows  that  Disposal  Costs,  Other  O&M 
Costs,  and  Equipment  Costs  are  also  fairly  significant.  In  fact,  these  four  cost 
categories  alone  contribute  89.30%  of  the  total  project  cost,  on  average.  The 
remaining  eleven  cost  categories  combine  for  the  final  10.7%,  and  are  relatively 
insignificant. 

Calculations  and  Comparisons 

Following  the  methods  described  in  Chsqiter  III,  an  initial  model  was  built 
consisting  solely  of  the  most  significant  cost  category,  Input  Material  Costs.  Then, 
using  only  the  data  from  this  cost  category,  a  i»w  NPV  for  each  of  the  109  projects 
was  calculated.  These  new  NPVs  were  then  compared  with  the  actual  NPVs  for  each 
of  the  projects,  the  number  of  matches  determined,  and  the  model  effectiveness 
calculated,  as  described  in  Chapter  III.  In  this  case,  using  just  the  most  significant  cost 
category,  a  total  of  64  matches  was  achieved,  for  an  effectiveness  of  59.72%. 

Adding  further  significant  cost  categories  improved  the  effectiveness  of  the 
screening  model  (see  Table  2  below).  Including  a  second  cost  category  yielded  a 
model  with  an  effectiveness  of  72.48%,  adding  a  third  category  increased  effectiveness 
to  81.65%,  adding  a  fourth  improved  it  to  90.83%,  and  adding  a  fifth  category 
improved  effectiveness  to  93.58%. 
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Table  2.  Summary  of  Model  Effectiveness 


Cost  Categories  Included 

Matches 

Effectiveness 

Iiq)ut  Materials 

64 

59.72% 

Iiq)ut  Materials,  Disposal 

79 

72.48% 

Iiq)ut  Materials,  Other  O&M 

79 

72.48% 

Iiq)ut  Materials,  Process  Equipment 

69 

63.30% 

Input  Materials,  Disposal,  Other  O&M 

89 

81.65% 

Iiq)ut  Materials,  Disposal,  Process  Equipment 

84 

77.06% 

Input  Materials,  Other  O&M,  Process  Equipment 

84 

77.06% 

Input  Materials,  Disposal,  Other  O&M,  Process  Equipment 

99 

90.83% 

Input  Materials,  Disposal,  Other  O&M,  Process  Equipment,  Construction 

101 

92.66% 

Input  Materials,  Disposal,  Other  O&M,  Process  Equipment,  Installation 

101 

92.66% 

Input  Materials,  Disposal,  Other  O&M,  Process  Equifanent,  Training 

102 

93.58% 

Input  Materials,  Disposal,  Other  O&M,  Process  Equipment,  Utilities 

100 

91.74% 

Figure  5  shows  how  the  effectiveness  of  the  model  increased  as  further  cost 
categories  were  added.  Because  including  additional  cost  categories  in  the  screening 
model  requires  more  data,  it  therefore  requires  more  work  to  implement.  Since  that  is 
exactly  the  work  that  this  screening  model  is  intended  to  avoid,  it  was  desirable  to  limit 


Figure  5.  Improvements  in  Effectiveness  Achieved  by  Adding  Cost  Categories 
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the  number  of  cost  categories  used  in  the  model.  However,  it  was  also  desirable  to 
build  a  screening  model  with  a  high  level  of  effectiveness.  The  balance  between  the 
two  was  achieved  by  adding  cost  categories  to  the  model  until  the  addition  of  further 
cost  categories  did  not  increase  effectiveness  enough  to  warrant  the  increase  in  the  data 
collection  workload.  Figure  5  shows  that  adding  up  to  four  cost  categories  to  the 
model  resulted  in  a  significant  improvement  in  model  effectiveness  at  each  increment, 
but  when  the  fifth  cost  category  was  added  a  much  smaller  increase  was  achieved. 
Because  this  fifth  cost  category  contributed  so  much  less  to  the  effectiveness  of  the 
model  than  the  other  four  cost  categories,  it  did  not  make  any  significant  improvement 
to  the  model  and  therefore  its  inclusion  did  not  justify  the  increased  data  collection  it 
would  require.  Thus  the  fifth  cost  category  was  not  added,  and  the  final  model 
indicated  by  this  research  contained  only  the  following  four  cost  categories:  Input 
Materials,  Disposal,  Other  O&M,  and  Process  Equipment. 

Sensitivity 

The  four-cost  model  selected  here  only  indicated  90.83%  of  the  Hill  AFB  projects 
correctly.  The  model  indicated  the  remaining  9.17%  (10  projects)  as  shown  in  Table  3 
below. 


Table  3.  Summary  Information  for  Incorrectly  Indicated  Projects 


Indicated 

Actual 

#  Projects 

Percentage 

Sound 

Unsound 

False  Positive 

Four 

3.67% 

Sound 

C^estionable 

False  Positive 

One 

0.92% 

(^estionable 

Unsound 

Acceptable 

Four 

3.67% 

Unsound 

Sound 

False  Negative 

One 

0.92% 
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As  the  Table  shows,  five  projects  were  indicated  as  being  sound  when  they  were  not, 
resulting  in  a  4.59%  false  positive  error  rate.  This  is  significant  because  false  positives 
will  generally  result  in  the  expenditure  of  moi^y  and  time  implementing  pollution 
prevention  projects  which  will  eventually  lose  money.  Four  projects  were  indicated  as 
questionable  when  unsound,  which  is  accept2d>le  because  it  is  assumed  that  these 
projects  would  be  studied  further  and  more  information  will  correctly  reveal  the 
project's  true  economic  soundness.  This  avoids  the  loss  of  funds  involved  in 
implementing  dies  unsound  projects,  but  does  not  avoid  the  expense  of  extensive  study. 
Finally,  only  one  project  reported  a  false  negative  error,  indicating  that  only  a  small 
number  of  good  pollution  prevention  opportunites  will  be  missed  by  this  model. 

Discussion 

The  results  of  this  simple  yet  revealing  analysis  indicate  that  it  is  possible  to 
predict,  with  better  than  90%  effectiveness,  the  economic  soundness  of  a  pollution 
prevention  project  using  a  model  containing  only  four  cost  categories.  If  a  lesser 
degree  of  effectiveness  can  be  tolerated,  a  model  containing  even  fewer  cost  categories 
can  be  used,  which  requires  less  data  and  thus  simplifies  the  work  needed  to  implement 
a  model.  The  ability  to  predict  the  economic  soundness  of  a  project  is  valuable  as  this 
knowledge  can  be  used  to  help  ensure  that  only  projects  with  economic  benefits  are 
selected  for  a  costly  detailed  study. 
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V.  Summary 


Research  Summary 

This  research  set  out  to  develop  a  technique  which  can  quickly  ami  easily  provide  a 
reliable  estimate  of  the  economic  soundness  of  a  pollution  prevention  project.  In 
chapter  II  the  need  for  this  technique  was  described  along  with  some  necessary 
background  information.  In  Chapter  III  the  processes  used  to  develop  this  technique 
were  discussed,  and  in  Chsqiter  IV  an  actual  technique  was  developed  and  evaluated. 
The  final  result  of  this  work  is  that  its  intended  goal  was  achieved,  and  a  working 
technique  has  been  provided.  By  employing  this  technique  in  their  pollution  prevention 
programs,  US  Air  Force  Installations  can  effectively  screen  their  pollution  prevention 
projects  as  specified  in  the  existing  guidam%  fm  the  opportunity  assessment  process. 

Benefits  Of  This  Technique 

The  biggest  benefit  of  using  the  technique  developed  in  this  thesis  is  that  it 
provides  a  way  for  an  Air  Force  Installation  to  identify  the  economic  soundness  of  its 
pollution  prevention  projects  earlier  in  the  opportunity  assessment  process.  This  gives 
that  installation  the  opportunity  to  begin  implen^nting  the  economically  sound  projects 
sooner,  reveals  those  economically  unsound  projects  which  should  be  deleted  from  the 
pollution  prevention  program,  and  then  only  perform  full  economic  analyses  on  the 
questionable  projects.  The  technique  can  also  be  used  by  a  base  to  perform  an 
independent  check  on  any  economic  analyses  performed  by  a  contractor.  Finally,  in 
cases  where  bases  have  for  one  reason  tv  anodier  opted  not  to  perform  economic 
analysis  of  their  pollution  prevention  projects,  this  tedinique  offers  a  simple  method 
which  could  provide  them  with  some  limited  yet  reliable  economic  information  on 
which  to  base  their  decisions. 
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Recommendations  For  Further  Study 

There  are  two  specific  areas  in  which  this  research  can  be  studies  further: 

Collect  additional  data  and  vaUdate/refute  the  technique.  The  dataset  used  to 
develop  this  screening  technique  contained  information  from  only  one  Air  Force  base. 
Because  most  Air  Force  bases  contain  similar  facilities  and  perform  the  same 
operations,  it  is  not  unreasonable  to  assume  that  a  screening  tool  that  works  at  one  base 
would  work  at  any  of  the  other  bases.  However,  in  order  to  be  certain  that  this  is  a 
valid  assumption,  additional  cost  data  from  a  different  Air  Force  base  should  be 
collected,  if  it's  available,  and  used  to  test  this  screening  technique  more  thoroughly. 

Examine  the  impact  cf  missing  cost  categories.  The  data  used  in  this  research  was 
collected  by  a  contractor  in  accordance  with  specifications  provided  by  Hill  Air  Force 
Base.  It  considered  only  the  costs  categories  listed  in  AFR  173-15,  "Economic 
Analysis  and  Program  Evaluation  for  Resource  Management",  which  was  released  by 
the  Air  Force  in  1988.  Since  then,  new  research  has  indicated  that  cost  categories  not 
listed  in  AFR  173-15,  such  as  medical  costs,  liability  costs,  and  public  image  costs, 
may  be  significant  costs  which  should  be  considered  when  evaluating  pollution 
prevention  projects.  Information  on  these  costs  was  not  contained  in  the  Hill  AFB 
data,  and  so  was  not  considered  in  the  develqiment  of  the  screening  technique.  It  is 
conceivable  that,  if  data  on  these  costs  categories  had  been  available,  the  results  of  this 
research  may  have  been  different.  Further  study  could  determine  if  this  is  true  or  not. 
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APPENDIX  A 

Hill  Air  Force  Base  Data  Sample 
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The  following  are  some  general  assumptions  made  by  the  Engineering  Science 
engineers  during  their  c^portunity  assessment  of  Hill  Air  Force  Base. 


1.  Net  Present  Worth  analysis  is  used  for  comparing  projects. 

2.  The  discount  rate  of  7%  was  provided  by  the  Hill  AFB  Financial  Management 
Directorate. 

3.  The  economic  life  is  equal  to  the  physit^  or  technical  life.  Therefore,  no 
salvage  life  is  assumed  at  Ae  end  of  Ae  economic  life. 

4.  The  average  personnel  salary  at  Hill  AFB  is  $41,551,  which  equates  to 
$20/hour.  This  figure  was  also  provided  by  the  Hill  AFB  Financi^  Management 
Directorate. 

5.  There  are  approximately  245  working  days  per  year  with  8-hour  shifts. 

6.  All  personnel  are  100%  productive.  Therefore,  any  projects  requiring 
persom^l  activity  (i.e.  installation,  training,  etc.)  assume  a  labor  cost  of  $20/hour. 

7.  Additional  assumptions  may  be  made  for  specific  projects.  These  additional 
assumptions  are  listed  with  their  supporting  calculations  in  Appendix  A  of  the 
Opportunity  Assessment  report. 


Page  33  contains  a  sample  data  sheet  from  one  of  the  109  projects  evaluated  at  Hill 
AFB  which  were  used  for  this  research.  The  following  paragraphs  contain  explanations 
of  some  of  the  entries  and  calculations  on  the  sample  data  sheet. 


1.  Base  CtMts.  Operating  and  Investment  costs  for  the  current  operation. 
Operating  costs  are  on  an  annual  basis.  Investment  costs  will  normally  be  zero. 
Costs  are  shown  as  a  positive  value. 
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2.  Project  Investment  Costs.  Capital  costs  required  to  purchase  equipment,  train 
personnel,  etc.  Costs  are  shown  as  a  positive  value.  The  differential  cost  is  the 
project  investment  cost  subtracted  from  the  base  (current)  investment  cost.  A 
negative  differential  cost  value  indicates  the  additional  cost  for  the  project. 

3.  Project  Operating  Costs.  Annual  operating  costs  required  if  the  project  is 
implemented.  A  positive  value  indicates  a  cost.  The  differential  cost  is  the  project 
operating  cost  subtracted  from  the  base  (current)  operating  cost.  A  positive 
differential  cost  value  indicates  an  annual  cost  savings  for  the  project. 

4.  Present  Value  of  Project.  Calculated  using  a  7%  discount  factor,  the  economic 
life,  and  the  total  operating  costs  and  investment  costs  for  the  affected  cost 
elements.  Shown  as  a  positive  cost  value.  No  differential  costs  are  used  for 
calculating  this  value.  Present  value  of  project  is  used  to  calculate  the  contribution 
of  each  cost  category  to  the  total  project  cost.  These  values  are  shown  for  all  109 
projects  in  Appendix  II. 

5.  Percent  of  Cost.  The  percentage  of  the  project’s  total  present  worth  contributed 
by  each  cost  category.  These  values  are  shown  for  all  109  projects  in  Appendix  II. 

6.  Total  Investment  Cost.  Total  capital  required  to  implement  project. 

7.  Total  Annual  Operating  Costs/Savings.  Total  annual  savings  or  costs  if  project 
is  implemented.  Positive  value  indicates  an  annual  savings.  Negative  value 
indicates  an  additional  cost  to  the  current  process  costs. 

8.  Payback  Period.  The  total  investment  cost  (6)  divided  by  the  total  annual 
costs/savings  (7).  This  value  indicates  the  number  of  years  required  to  recoup  the 
initial  investment  costs  of  the  project. 

9.  Net  Present  Value.  The  present  value  of  the  total  net  annual  operating 
costs/savings  over  the  economic  life  of  the  project  minus  the  total  investment  costs. 
Shown  as  a  positive  costs  savings  value. 
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APPENDIX  B 

Siumnary  of  Project  Cost  Data  and  Percentage 

Contribution  Data 
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of  Project  Cost  Data  and  Percentage  Contribution  Data 
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